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Abstract: We consider the discrete Hammersley-Aldous-Diaconis process (HAD) and the 
totally asymmetric simple exclusion process (TASEP) in Z. The basic coupling induces 
a multiclass process which is useful in discussing shock measures and other important 
properties of the processes. The invariant measures of the multiclass systems are the same 
for both processes, and can be constructed as the law of the output process of a system of 
multiclass queues in tandem; the arrival and service processes of the queueing system are 
a collection of independent Bernoulli product measures. The proof of invariance involves 
a new coupling between stationary versions of the processes called a multi-line process; 
this process has a collection of independent Bernoulli product measures as an invariant 
measure. Some of these results have appeared elsewhere and this paper is partly a review, 
with some proofs given only in outline. However we emphasize a new approach via dual 
points: when the graphical construction is used to construct a trajectory of the TASEP or 
HAD process as a function of a Poisson process in Z x R, the dual points are those which 
govern the time-reversal of the trajectory. Each line of the multi-line process is governed by 
the dual points of the line below. We also mention some other processes whose multiclass 
versions have the same invariant measures, and we note an extension of Burke's theorem 
to multiclass queues which follows from the results. 
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1. Introduction 



The macroscopic evolution of the totally asymmetric simple exclusion process (TASEP) 
[21111^ and the Hammersley-Aldous-Diaconis process (HAD) ^30] can be described by the 
Burgers equation (23 |2H] • This equation admits shock solutions which have a microscopic 
counterpart. A crucial tool for the study of these shocks is Liggett's basic coupling [TTIII2U] 
of two or more copies of the process; see for example jH [TUl E3 Ell- These coupled 
processes have a natural interpretation as a process with two or more classes of particle 
(which is also of interest from a combinatorial viewpoint 0E])- Such coupled and multiclass 
processes, and their invariant distributions, are the subject of this paper. 

l 
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Our basic objects are the TASEP and a discrete-space version of the HAD process [5lll6j. 
These are continuous-time Markov processes taking values in the state-space X = {0, 
for a configuration 77 G X, we say that 77 has a particle at x (or that x is occupied) if 
r](x) = 1, and that 77 has a hole at x (or that x is empty) if r](x) = 0. In the TASEP, each 
particle tries to jump one site to the left at rate 1, succeeding if the site to its left is empty. 
In the HAD process, each empty site summons at rate 1 the nearest particle to its left. 

The graphical construction allows us to realize either the TASEP or the HAD process as a 
function of a rate 1 Poisson process onRxZ (the process of "marks" or "points" or "bells" ) 
and the initial configuration. Under the basic coupling, processes started at different initial 
conditions r] 1 ,r] 2 , . . . ,rj n are coupled by using the same realization of the Poisson points. 
Suppose the initial configurations are ordered, in that r] l {x) < rj 2 (x) ■ ■ ■ < r] n (x) for all 
x G Z. Then this ordering is preserved by the dynamics of the coupling, and we obtain a 
coupled process taking values in the space X n ^ of ordered configurations, defined by 

X n ^ = {(r) 1 ,...,^) G X n : V \x) < ■■■ < V n (x) for all x G Zj . (1) 

We define a map R : X n ^ 1— > y n — {1, 2, . . . , n + 1} Z , taking an ordered configuration rj 
into a multiclass configuration £ = Rq, by 

^ X )=n + 1-J2v k (x). (2) 

k=l 

The multiclass configuration £ labels each site i with a class. The larger the number of 77 
particles at site i, the lower is its class. If a site is occupied in all n marginals of rj, then 
£(x) = 1 and we say that x contains a first-class particle. If rj l (x) = but rf(x) = 1 
then x contains a second-class particle (£(x) = 2), and so on. When x is empty in all the 
marginals of 77, £ gives value n + 1 at %. Conventionally, we regard such sites with value 
n + 1 as holes (this is also how they are displayed in the figures in this paper), though 
they could equivalently be regarded as particles of class n + 1. A coupled process (r] t ) 
taking values in X n ^ induces a multiclass process (£t) = (Rrjt); since R is a bijection, the 
two are essentially equivalent. In the case of the TASEP, the dynamics of the multiclass 
process have a natural interpretation as a TASEP in which lower-numbered particles have 
priority over higher- number particles, and can jump from the right to displace them; these 
dynamics are related to various sorting algorithms. 

The Bernoulli product measures v p on X of density p G (0, 1) are invariant for both 
the HAD process and the TASEP. We look for invariant measures for the corresponding 
coupled processes, whose kth marginal is u p for each 1,2, ... ,k, for fixed densities < 
p 1 < ■ ■ ■ < p n < 1. The family of invariant measures ir = ir 1 ^ n obtained for the coupled 
process is the same for the TASEP and for the discrete HAD process, and also for various 
other particle systems with values in X. To each such ir corresponds a distribution /i on 
y n , which is invariant for the multiclass process. The form of /1 can be obtained as the 
stationary output process of a system of multiclass ./M/l queues in tandem. A striking 
property of these invariant measures is that a sample 77 from ir can be obtained as a 
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deterministic function T of a configuration a G X n with distribution v = v p x • • • x v p , 
a product of Bernoulli product measures. 

To show that n and fi are invariant for the coupled and multiclass process respectively, 
one can perform a generator-like computation as [31111011201 did for the 2-class TASEP. We 
proceed otherwise, introducing a new process at = (aj, . . . , a") on X n called a multi-line 
process and showing that (a) the product of product measures v is invariant for the multi- 
line process and (b) the process Ta t is the coupled process. See [12] for the TASEP and 
[TT] for an analogous construction for the continuous-space HAD process. We review the 
method in this paper, and describe an approach to the multi-line process via dual points, 
rather different to the approach of [T2"j . 

Stationary versions of the TASEP and the HAD process can be constructed as determin- 
istic functions of the Poisson process uj. For each density p and almost all Poisson point 
configurations uj, there exists a unique trajectory of the process (r] t , f 6 R) with time- 
marginal distribution v p and governed by uj. This was proved for the continuous-space 
HAD process in ^T] and the proof extends to the cases discussed here. The uj points and 
the trajectory of the process induce new points D p (uj), defined — roughly speaking — as 
the points governing the time-reversed trajectory. They are called dual points and, just as 
uj itself, form a Poisson process on R x Z. In addition, the dual points with time coordinate 
less than t are independent of the particle configuration at time t. These properties have 
been shown for the continuous-space version of the HAD by Cator and Groeneboom [3J; 
see also We show them here for both the TASEP and the discrete HAD process. 

The proof is a bit more complicated because a trajectory in the discrete-space case does 
not determine all the Poisson points governing it. To overcome this problem we augment 
the state-space and introduce spin-flip processes to mark the Poisson points missed by the 
trajectories. See Proposition for the HAD and Proposition ITU1 for the TASEP. These are 
the main new results of this paper. 

One way to construct a stationary trajectory (a t , t G R) of the multi-line process referred 

1 n 

to above, whose marginal distribution at any fixed time t is v = v p x • • • x v p , is as follows. 
The bottom line (a™, t G R) of the process is constructed as a the unique trajectory with 
marginal z/ p ™ governed by the Poisson points uj. The dual points uj n ~ l of the bottom 
trajectory and the density p™" 1 are then used to construct the (n — l)st line, and so on. 
Since a\, the kth marginal at time t, depends only on the Poisson points uj k with time 
coordinate less than t, which are independent of a\ _1 , . . . ,a\, the resulting distribution of 
a t G X n is indeed the product distribution v. The process is time-invariant by construction. 

In the case of the continuous-space HAD process, the multi-line process is closely related 
to the polynuclear growth model studied by Prahofer and Spohn [2UI2S1; see also [T31 114j. 
In those papers the points in uj and the dual points are called nucleation events and 
annihilating events respectively; see in particular Figure 2 in |13| . 

In Section [21 we construct the coupled invariant measure tt and the multiclass invariant 
measure fj, as functions of a product of Bernoulli product measures. In Section El we review 
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the proof of the invariance of n (or p) for the coupled (respectively, multiclass) HAD 
process; at the end of this section we mention a case of the long range exclusion process 
which is equivalent to the HAD process. In Section 0] we review the proof for the case of the 
TASEP. In Section 03 we give some examples of other dynamics for which the associated 
multiclass processes have the family of measures /i as invariant distribution, including 
certain "sequential" TASEPs defined in discrete time. We also mention various related 
cases for which \x is not invariant. Finally, in Section |3 we note a multiclass generalization 
of Burke's theorem. The measures /i constitute fixed point arrival processes for a multiclass 
priority ./M/l queue, in the sense that the law of the output process of the queue is the 
same as the law of the input. This property can be deduced from the invariance of /i and 
the tandem queue construction used in the proof (although more direct proofs are also 
available; see 

In summary, our main aims in this paper are as follows: (i) to review the results of 
[T2] and ^T] describing invariant measures of multiclass processes; (ii) to illustrate the 
application of the results and methods to various different particle systems; (iii) to describe 
an approach via dual points which adapts well to various different processes and which 
differs, for example, from the more specific arguments used in ^2] for the TASEP case, 
and (iv) to emphasize the correspondence between the multiclass process with values in 
y n and the coupled process with values in X n ^ . 

2. Multiclass invariant measures 

In this section we will construct a family of measures on X n \ which we will later show 
to be invariant for the coupled HAD and TASEP processes. For given particle densities 
< p 1 < ■ ■ ■ < p n < 1, we will construct a measure ir = 7T i „ on X n ^ whose fcth marginal 

will have distribution v p , Bernoulli product measure of density p (that is, the measure 
under which each site is occupied independently with probability p k ). 

Let rj have distribution ir, and write £ = Rr] G y n for the configuration obtained from 
the map defined at (J2J). Since ir is invariant for the coupled processes, the distribution 
/j, = Rtt of £ will be invariant for the corresponding multiclass processes. 

The invariant measure it on X n ^ is constructed starting from product measure v = 
v p x ■ • • x v pn on X n . Let a = (a 1 , . . . , a n ) 6 X n be distributed according to this product 
measure v. We will interpret the particles of a as events in a system of queues in tandem 
in discrete time; the sites of Z now correspond to times in the queueing system. 

2.1. Construction of the coupled invariant measure ir. Consider a queueing server 
in discrete time, governed by a 1 and a 2 in the following way. The particles of a 1 represent 
times at which a customer arrives at the queue, and the particles of a 2 represent potential 
service times (that is, times at which a customer can depart from the system, if any are 
present). At time i, the queue length increases by 1 if a l (i) = 1 and a 2 (i) = 0; it stays 
the same if a 1 (i) = a 2 {i); and it decreases by 1 if a l (i) = and a 2 (i) = 1, unless it was 



already in which case it remains 0. Then if Z(j) is the queue length just after time j, 
one has 

Z(j) = (Z(j-l) + a\j)-a 2 (j)) + , jeZ. (3) 

Since a 1 and a 2 are distributed as independent Bernoulli product measures, with densities 
p 1 and p 2 respectively, and p 1 < p 2 , the queue- length process Z is a positive recurrent 
Markov chain (in fact, its stationary distribution is geometric with parameter p 1 /p 2 ), and 
there is an essentially unique way to construct a stationary process Z as a function of the 
input a, namely by 

^') = ^p(EK(0-« 2 W]) • (4) 

r — 3 \ i=r / _i_ 

The evolution of Z(j) is illustrated in Figure H It can be seen that if an arrival and a 
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Figure 1. Construction of (Z(j)). The queue is empty at the moment of 
the first service time. In the plot of Z unused services are indicated with a 
small vertical mark and arrivals served instantaneously with a long vertical 
segment. 

potential service occur at the same time, a customer may spend no time in the system; 
this is the case of the last customer to arrive, coupled configuration is 

The configuration D = D(a l ,a 2 ), representing the departure times from the queue, is 
then defined by 

|l if a 2 (j) = land Z(j- I) + a\j)>0 
1 otherwise. 

The interpretation is that D(j) = 1 if a customer departs from the queue at time j. 
Allowing the value oo in (@J), this definition of the operator D : X 2 i— > X makes sense for 
any a 1 and a 2 , but in fact we will only use it in cases where a 1 and a 2 have independent 
Bernoulli product measures of densities p 1 and p 2 with p 1 < p 2 . Then the queueing 
process is stable (since the rate of arrivals is lower than the rate of services). In queueing 
theory terminology the queue is called a discrete-time M/M/l queue (where "1" indicates a 
single-server queue and "M" stands for memoryless, indicating that the arrival and service 
processes each have product measure). 
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We note the following useful properties of the operator D. The first two follow imme- 
diately from and (0), while the third is Burke's Theorem for a discrete-time M/M/l 
queue [T£] : 

Proposition 1. 

(i) D(a\a 2 ) < a 2 . 

(ii) If a 1 < a 1 then D{&\a 2 ) < D{a\a 2 ). 

(iii) If a 1 and a 2 have independent Bernoulli product measures of densities p 1 and p 2 
with p 1 < p 2 , then D{a 1 ^a 2 ) also has Bernoulli product measure with density p 1 . 

We now define a sequence of operators : X n i— > X as follows. Let D'^a 1 ) = a 1 , 
and then recursively for n > 2, let 

^"'(a 1 , a 2 , . . . , a n ) = D (D^^a 1 , . . . , a™" 1 ), a n ) . (6) 

The configuration D^^a 1 , a 2 , . . . , a n ) represents the departure process from a system of 
(n — 1) queues in tandem. The arrival process to the first queue is a 1 . The service process 
of the kth queue is a k+1 , for k = 1, . . . , n — 1. Finally, for k = 2, . . . , n — 1, the arrival 
process to the /cth queue is given by the departure process of the {k — l)st queue. This is 
known system of -/M/l queues in tandem. 

Note /^^(ct 1 , a 2 ) = Z^a 1 ,^ 2 ). By applying Proposition [T] repeatedly, we obtain the 
following properties of D^ n >: 

Proposition 2. 

(i) D( n \a\ ...,a n )< D^ l \a 2 , . . . , a n ) < ■ ■ ■ < a n . 

(ii) If a 1 , . . . , a n have independent Bernoulli product measures of densities 

p 1 < ■■■ < p n , then D^^a 1 , . . . , ct n ) also has Bernoulli product measure with 
density p 1 . 

Now define the configuration rj = (r) 1 , . . . , rj n ) by 

V k = D {n - k+l \a\a k+ \...,a n ). (7) 
From Proposition |21 we have that 

(i) 7] E X n ^ (that is, r\ k < r] k+1 for all k = 1, . . . , n - 1); 

(ii) for each k, r) k has marginal distribution v p . 

We then define the map T : X n i— > X n ^ by Ta = rj. The desired distribution tt on X n ^ is 
the induced distribution of rj (that is, n = Tu) . 

2.2. Construction of the multiclass measure p. Let rj have the distribution tt con- 
structed above, which we will show to be invariant for the coupled HAD and TASEP 
processes. Let £ = Rr], where R is the map defined at (0). Then p = Rtt, the distribution 
of £, will be invariant for the multiclass HAD and TASEP processes. 
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This multiclass invariant measure can also be described directly via a tandem queueing 
system with multiclass queues. (This direct construction described below is not necessary 
to understand the proofs of invariance in later sections, which are written in terms of the 
construction of n given in the previous section). 

As before, the system will now contain n — 1 queues. The arrivals to the first queue are 
again the particles of a 1 . For k = 2, . . . , n — 1, the arrivals to the fcth queue correspond to 
the services of the (k— l)st queue, and are given by the particles of a k . These are partitioned 
into k — 1 different classes; these classes will be served by the kth queue according to a 
priority policy, under which lower-numbered classes are served ahead of higher-numbered 
classes. A class r customer departing from queue k — 1 becomes a class r customer arriving 
at queue k; an unused service at queue k — 1 becomes a class k customer arriving at queue 
k. Finally, the services of the (n — l)st queue are given by the particles of a n , and will 
be assigned n different classes; this will yield the n-type multiclass configuration desired, 
distributed according to u. 

The partition of the particles of a k into k classes is written using configurations , . . . , /3% 
such that ft* + ■ ■ ■ + = a k . The configuration (3 k represents the a fc -particles of class r, 
for r = 1, 2, ... k. 

Of course f3\ = a 1 . Then for 2 < k < n, we set 



When a customer departs from queue k (that is, when an a fc -service occurs and there 
is at least one customer present), the customer which departs is the lowest-numbered one 
present (including one which may just have arrived). From the equations above for the (3 k , 
this may be understood as follows: the rth-class customers arriving at queue k experience 
a service process which corresponds to a k but with the service times used by customers of 
classes 1, . . . , r — 1 removed. 



Now the multiclass configuration £ is derived from the nth line in the natural way; for 
k = 1, 2, . . . , n, let = k if ffi(j) = 1; otherwise (i.e. if a n {j) = 0) let f (j) =n + l. Call 



the resulting multiclass configuration. 

The construction is most easily understood from a picture; see Figure 121 for an example 
with n = 3. 

The relations between the multiclass configuration £, the multi-line configuration a and 
the ordered (or coupled) configuration t] = Ta is given by 



0i 



D((3 k -\a k ); 

D{(3 k ~\ a k -f3\ P?^) for 1< r < k; 




£ = Ma e y n = {!,..., n + 1} 



£ = Rrj = R(Ta) = Ma. 



(8) 
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Figure 2. Construction of £ = Ma. Here n = 3. Each particle on line k 
represents a site i such that a h (i) = 1; the particle carries the label r such 
that fi(i) = 1 (representing a particle of rth class). In this diagram and 
later, sites in the multiclass configuration £ with value n + 1 are treated as 
holes and left empty. 
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Figure 3. From independent to ordered configurations 



This correspondence is illustrated in Figure El To establish formally this equivalence be- 
tween the construction of the function M here and the construction of the function T in 
the previous section, one can check by induction that for any 1 < r < k < n, 

$ + $ + + Pr = £ (fc_r+1 V, . . . , a k ). 

Define fi = Mv = RTv. This is the distribution of £ = Ma when a consists of n 
independent configurations with Bernoulli product distributions of parameters < p 1 < 
■■■ <p n < 1. 



2.3. The case n = 2. We give a few words about the constructions above in the case 
n = 2. We now have a single queue with arrival process a 1 and service process a 2 (that 
is, a single M/M/l queue). The particles of if are simply the particles of a 2 , that is, 
the potential service times. The particles of rj 1 are the subset of those times where a 
departure actually occurs, namely the particles of D{a 1 : a 2 ). The discrepancies between 
the two configurations t] 1 and rj 2 correspond to second-class particles in the two-class 
interpretation; that is, to sites j where £(j) = 2. These correspond to unused services in 
the queue. 



9 



This construction was described by Angel [2] for the invariant measure of the two-class 
TASEP. The queueing interpretation can be found in Ferrari and Martin ^2]- The measure 
so obtained has been first computed by Derrida, Janowsky, Lebowitz and Speer j3] and 
then described in other ways by [HI EH1 IS] for the two-class TASEP. 

3. Discrete HAD 

The discrete-space Hammersley-Aldous-Diaconis process is a continuous-time Markov 
process taking values in a subset of X . At rate one each site j calls the closest particle to 
the left of j (including j) making it jump to j. The generator of the process is 

L H f(v) = " /(»?)] ( 9 ) 

where, writing i = i(r],j) = ma.x{k < j : r)(k) = 1} for the closest occupied site of rj to the 
left of j, 

rj(k) iik^ij 
AjT]{k) = { I if k = j (10) 
if k = i and i < j 



_Q_ 
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Q before 
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™ « jump 



Figure 4. Discrete Hammersley process. Jumps occur at rate 1 



Harris graphical construction. To construct the process we attach to each site an 
independent Poisson process of rate 1; these processes form a rate-1 Poisson process on R x 
Z. Bells ring at the points (or space-time events) of this process, which are represented by 
* in Figure El The space of point configurations is called Q and single point configurations 
are called lo. When a bell rings at j (that is, at a time s such that (j, s) 6w), the closest 
particle to the left jumps to j. A possible point configuration and the resulting trajectory 
are illustrated in Figure El Such a construction is easily seen to be well-defined for the 
corresponding process in a finite region (since there are finitely many points of uo in any 
finite time-interval). To define the process on all of Z, we need to exclude the possibility 
of particles escaping immediately to +oo, and should restrict to the state space 

= j?7 G ;f : lim r" 1/2 = oo j . 



For details, see Seppalainen jzH] , where the analogous construction for the continuous-space 
HAD is carried out. 
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FIGURE 5. Harris construction 



If one calls lo a realization of the points, then the configuration at time t of the process 
is a function called of u and the initial configuration 770: 

{t,u,r] ) i-> (f)(t,uj,T]o) (11) 



For given 770 and u, the process (rjt,t > 0) defined by i] t = (j)(t,u,rjo) is called the HAD 
process governed by uj with initial condition t]q. In fact one has 

Tj t = 4>{t - S,U),7] S ) (12) 

for all < s < t < 00. 

The invariant measures of the HAD process are the Bernoulli product measures v p with 
density p G (0, 1] (and mixtures of them). 

Using the Kolmogorov extension theorem, we can dispense with the initial condition and 
construct jointly the Poisson points uo and an evolution (rjt,t G M) such that, for all t, the 
marginal distribution of rjt is u p , and which satisfies (|T2"|) for all —00 < s < t < 00. We 
again say that (r) t ,t G M) is governed by lo. In fact, it turns out that the construction of 
such a bi-infinite trajectory is essentially unique, as soon as the particle density p is fixed: 

Proposition 3. Let p G (0, 1). Then there exists an essentially unique function H p map- 
ping elements uj of Q to trajectories (rjt,t G M) such that: 

(i) The induced law of (rjt,t el) = H p (u) is stationary in time. 

(ii) The marginal law of rj t for each t is space-ergodic with particle density p. 

(iii) With probability 1, (r] t ,t el) is a HAD evolution governed by uj. 

(Here "essentially unique" means that if H' is another function satisfying the three con- 
ditions, then H p (uj) = H' (uS) with probability 1). Then in fact the marginal law of r\t for 
each t is v p . 



11 



Proposition |21 can be proved following the approach of Ekhaus and Gray jH]; see Mount- 
ford and Prabhakar j2H| anc ^ our P ro °f f° r the continuous-space HAD in [TJ . One might 
conjecture that a stronger statement holds: for almost all U), there exists a unique HAD 
trajectory (rjt,t G M) governed by u> such that, for all t, the configuration r\ t has particle 
density p. 

Coupling. Different initial configurations t]q, . . . , 7$ with the same Poisson bells u produce 
a joint process whose marginals are the HAD process with those initial configurations: 

Hence for an initial condition r] = (t/q, . . . , rj^ ) 6 X n , we can describe the coupled HAD 
process by 

rj t = (n) (t,w,r/ o ), 
where the function (f>^ :lxOx X n \— > X n is defined by 

(<l>( n '>{t,u>,ri)) k = <Kt,u,ri k ). 
The generator of the coupled process is given by 

Lcf(v) = Yytt C M) ~ f(v)} (13) 

where 

Cj'l (•>,'/' >,'/")• (14) 

for A, defined in (fTUjl . 

If the initial configurations are ordered, that is, r/o(^) — r /o +1 (^)' f° r a H h then 77^ < r;f +1 
for all t. Put another way, we can regard the coupled process as a process taking values in 
the space X n ^ of ordered configurations. In Figure El we illustrate the jumps produced by 
a bell at site j in such a case. The closest particle to the left of j in each marginal jumps 
to j; the jumps are simultaneous. 

Multiclass process. From now on we indeed regard the coupled process as a process 
taking values in the space X n ^ of ordered configurations. Now we can regard as first-class 
particles the sites occupied in all marginals, second-class particles those occupied from the 
second marginal but not the first, and so on. The multiclass process is defined in terms 
of the coupled process by £ t := Rrj t . Since R is a bijection from X n ^ to y n . this is also 
a Markov process (whose behavior is not completely intuitive; compare for example with 
the more natural behavior of the multiclass TASEP process considered in Section HJ). The 
generator of the multiclass process can be written in terms of the generator of the coupled 
process by Lmc — RLqR~ 1 , and the operator R commutes with the dynamics of the 
coupled and multiclass processes. Figure illustrates the correspondence between the two 
processes. 
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Figure 6. Coupled and multiclass processes. Effect of a bell at j 
3.1. Invariance of p. 

Theorem 4. Let a = (a 1 , . . . , a 11 ) have law v, product of Bernoulli product measures with 
densities p 1 < ■ ■ ■ < p n . Then it, the law ofTa, is invariant for the coupled HAD process 
(r] t ) and p, the law of Ma, is invariant for the multiclass HAD process (£ t ). 

Sketch of proof. From (jSJ), the statements are equivalent. Hence it suffices to show that 
the law of = Ta is invariant for the coupled process. We do it in two steps. First 
introduce new dynamics at = (aj, . . . , aj 1 ) called the multi-line process, and then show: 

1) The product measure v is invariant for the multi-line process at- 

2) Ta t is the coupled process r) t - 

These statements are Propositions |H1 and [7| below. □ 

In fact one can go on to show that this family of measures /i, indexed by the densities 
p 1 , ■ . ■ ,p n , are the only extremal invariant measures for the multiclass process. The proof 
of such a result follows a coupling argument of Ekhaus and Gray [B] as implemented by 
Mountford and Prabakhar [22] • See for the argument for the continuous-space HAD 
process. 



3.2. Dual points. Given a particle density p G (0, 1) and a realisation of the Poisson 
marks lj, Proposition El provides a stationary HAD trajectory (r)t) = H p (uS) governed by uj 
with time-marginal v p '. 

We define another set of marks A p (cj) , called dual points. These are given by the positions 
of the particles just before jumps: 

A P H :={(i(r] t ^j),t) : (j, t) E uj} (15) 

where i(r),j) is the position of the closest rj particle to the left of j, as defined after Q. 
This includes "jumps" of null size, when % = j. 
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The points uj and the dual points A p (a>) are illustrated in Figure[7| Since the dual points 
are located in the space-time positions just vacated by particles, they govern the time- 
reversal of the trajectory. More precisely: the time-reversed and space-reversed trajectory 
is a HAD trajectory governed by (the time- and space-reversal of) A p (uj). In visual terms: 
turning Figure upside-down exchanges the roles of the stars and the circles. 



©- 



©■ 



©■ 
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time 



time t 



Figure 7. The dual points of the trajectory of Figure El are represented by circles. 



The law of the dual points A p (uj) is then also Poisson, just as the law of uj itself. This 
is the first part of the following result. 

Proposition 5. Let uj be a Poisson process in R X Z ; and let A p (uj) be the dual points for 
the HAD trajectory with particle density p governed by uj. Then A p (uj) is also a Poisson 
process in R x Z. Furthermore {(x, s) G A p (uj) : s < t}, the set of dual points earlier than 
t, is independent of the configuration rj t . 

Proof. The proof is in the spirit of Reich's proof of Burke's theorem, used by Cator 
and Groeneboom [3] for the continuous space HAD. The idea is to consider the time- 
reversal of the process, and goes as follows. As commented above, the dual points govern 
the reverse process. By doing a generator calculation (or verifying an equivalent detailed- 
balance property) one obtains that the time-reversal of the equilibrium HAD process with 
density p is again an equilibrium HAD process with density p, but now with jumps to the 
left. (Put another way, the time-reversal of the process has the same law as the space- 
reversal). Now we would like to conclude that that the dual points therefore must also 
be Poisson. However, in the discrete-space case, the problem is that the trajectory of the 
HAD process does not identify all the points which govern it; it is also necessary to keep 
track of the points producing null jumps, which are not visible from the trajectory alone. 
To overcome this, we will add an auxiliary spin-flip process. 

Let 7i G X be the process which behaves as follows: when a bell rings at j, if there is a r] 
particle at j, then flips to 1 —7(7). The process (rjt, 7*) is Markovian and has v p x v 1 ! 2 
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as invariant measure. Again, the time-reversed process defined by (?7 t *,7 t *) = (ri_ t -,l-t-) 
has the same law as the space-reflection of (?7t,7t): the jumps of ry t * go to the left and 
the law of the spin-flip 7 t * remains the same. On the other hand, given a trajectory of 
((Vtilt), t > 0) one can identify u as the space-time points (j,t) such that either an rj 
particle arrives at site j at time t or 7 flips at j at time t. The points governing the reverse 
process are the time reflection of A p (ct;). Since the reverse process has the same law as the 
space-reflected HAD+spin-flip process, the points governing it must be Poisson. 

For any t, the dual points {(j, s) G A p (ci;) : s < t} are the points governing the evolution 
of the reverse process on the time interval (— t, 00) starting at the configuration (7y* t ,7* t ), 
and are independent of this configuration. But this is just the configuration (r/t,7t) so the 
independence holds as desired. □ 

3.3. Multi-line HAD process. We now define a multi-line process at = (a|,...,aj l ) 
taking values in X n . It is again governed by a Poisson process w 011 1 x Z. 

Let p 1 , . . . ,p n G (0, 1). Let uj n = u, and, recursively for k = n — 1, . . . , 1, let = 
A p fe+i (u; fc+1 ). From Proposition El each u k is a Poisson process of rate 1 on R x Z. 

Now let the "fcth line" of the process, (a k ,t G R), be H p k(cu k ), the HAD trajectory with 
density p k governed by the points u k , as provided by Proposition El Thus each line of the 
process is a HAD trajectory governed by the dual points produced from the line below. 

Note also that, directly from the definition, (a], . . . , a" -1 ) is a multi-line process with 
densities p 1 , . . . , p n ~ l and governed by uj 11 ^ 1 . 

Proposition 6. The multi-line HAD process (a t ,t G M) is stationary, and the distribution 

1 n 

of a t for each t is the product measure v = v p x ■ • • x v p . 

Proof. By construction, the process is stationary and the marginal distribution of aj° is v p 
for any k and t. So we need to show that, for any fixed t, the configurations a], . . . ,a™ 
are independent. 

Let 2 < k < n. By Proposition the configuration a k is independent of the set of dual 
points (x, s) in A p k(uj k ) such that s < t. 

But the process (a^ -1 ^ < t) can be constructed as a function of precisely this set of 
dual points; and then, recursively, also the processes (a J s , s < t) for each 1 < j < k. 

In particular, we can construct ct k ~ l , a k ~ 2 ', . . . , a] from the given set of dual points. 

Thus for all i, the configuration a k is independent of af _1 , af -2 , . • • , a]. Hence all the 
a\ are independent as desired. □ 

Remark: The dynamics of the multi-line process governed by u> can be explained in a more 
constructive (or "local") way. Each bell (j, s) G uj = u) n causes an a n particle to jump to 
j, from j n say. This creates a bell (j n ,s) in u n ~ l , which summons an a n ~ l particle to j n 
from j n_1 , causing a bell (j n_1 , s) in uo n ~ 2 and so on. 
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The time-reversal of this process, with respect to the equilibrium measure v, can be 
described in the same way but with left and right exchanged and also top and bottom 
exchanged. When a Poisson bell rings at site i, the closest a 1 particle to the right of i 
(including i) located at a site called i 1 jumps to %. Then a bell rings at site i 1 for a 2 , and 
so on. See Figure |H1 An alternative proof to Proposition El is to show directly that the 
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Figure 8. Local construction of the multi-line HAD process and its time-reversal. 

process so defined is the reverse process with respect to the product measure. We followed 
such a strategy for the case of the TASEP in [T2] . 

Note also that in the definition of the multi-line process, and in Proposition El we don't 
require the densities p k to be increasing. 

Now we wish to show that the image of the multi-line process under the map T is the 
coupled process. 

Proposition 7. Let < p 1 < ■ ■ ■ < p n < 1, and let (a t ,t G R) be the multiline HAD 
trajectory governed by uj with densities p l , . . . ,p n . Let r\ t = Ta t G X n ^ . Then (f]f,t G R) 
is the HAD trajectory governed by uj, with particle density p k . 

Sketch of Proof of Proposition From the definition of T, we have 

v k = D (n- k+ l) ( a?j j a ny (16) 

From Proposition |2J we know that rfc has distribution v pk . So we simply need to show that 
the RHS of is a HAD trajectory governed by uj. 

Since (a h , . . . , a n ) is itself just a multi-line process (with n — k + 1 lines) governed by uj, 
it is enough to show that, for any n, D^(a\, . . . , a™) is a HAD trajectory governed by uj. 

We argue by induction. From the definitions of D^ n ' and of the multi-line process, the 
induction step is simple, using 

D^\a\, . . . , a?) = [D^- l \a], a?" 1 ), a?) 

and the fact that (a], . . . , a™ -1 ) is an (n — l)-line multiline process governed by uj 11 " 1 , as 
observed just before Proposition El 



16 



The base case n = 2 remains. We use the local description of the multi-line (in fact, 
two-line) process. Let (a\,a 2 ) be the two-line process governed by u. Each mark (x,s) 
in w = w 2 produces a jump in the process a 2 at time s, and a corresponding dual point 
(x' , s) which becomes a mark in uj 1 . This mark in uo 1 produces a jump in the process a 1 at 
time s. One needs to verify that the combination of the two jumps, in a 1 and a 2 , leads to 
a single HAD jump in the process D(ct l ,a 2 ), equivalent to a mark at x. In the language 
used at (|10|). we need to show D(Aj>a 1 , AjCt 2 ) = AjD(a 1 , a 2 ). This is not difficult to do 
by checking a small number of cases. Arguing jump by jump in this way, one obtains that 
D(aj, a 2 ) is a HAD process governed by u as required. We give a proof along these lines 
for the continuous-space case in and the same argument works here. □ 

'/ :! Q ■ ■ ■ Cf ■ □ □□□ □ □ ■ O ■ ■ ■ 
v 2 ODDOODDCTDDDDDODDD 
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Figure 9. Jumps in coupled and multiclass LREP due to bell at j. LREP 
particles are represented by squares and empty sites by balls. 

The long range exclusion process. The long range exclusion process (LREP) was in- 
troduced by Spitzer [30J. At rate one, a particle located at site x jumps to the first empty 
site found by a Markov chain with transition jumps p(., .) starting at x. Consider empty 
sites of the HAD process as particles and particles as empty sites. The resulting process fjt 
given by fjt(x) = 1 — rjt(x) is the LREP with transition matrix p(x, x — 1) = 1 (Guiol [Tfi]). 
The effect of a bell at j is represented by the map Ajfj(i) := 1 — Ajt](i). In this simple 
case, the site is just the first empty place to the left. The multiclass LREP (£ t ) has the 
same distribution as the multiclass HAD process with classes reversed. The coupled LREP 
is defined by fj^(x) = 1 — ?7™ +1_fc (x), where rj t = (r/l, . . . ,77") is the coupled HAD. The 
effect of the bell at j in the coupled LREP is given by the map Cjfj = (Ajfj 1 , . . . ,Ajfj n ). 
The multiclass LREP is given by Rfj = £. In the multiclass LREP when a bell rings at j, 
the particle at j jumps to the closest particle to the left of it with higher class or empty; 
simultaneously this particle jumps to the closest site to its left with higher class or empty, 
and so on. The jumps finish when a particle jumps to an empty site. See Figure 01 
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4. TASEP 

The totally asymmetric simple exclusion process, or TASEP, is a continuous-time Markov 
process in X with the following dynamics. At rate 1 if there is a particle at site i, it jumps 
one unit to the left (if the site to the left is empty). We use here the same notations as 
in the case of the HAD process to describe the analogous quantities for the TASEP. The 
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Figure 10. Jump in TASEP due to bell at i 
generator of the process is given by 

Lf(v) = X)[/CM) - fin)] 

j 

where here (differently from the HAD definition (jlOjl ) 

(Aj V )(k) = 



7](k) i£k£{j-l,j} 
max{r)(j - 1), rj(j)} ifk — j-1 
min{?7(j - 1), rj(J)} if k = j. 



(17) 



For the graphical construction of the process we will use a system of Poisson points or 
marks, this time on u on 1 x (Z + |) (so that the bells now ring between sites). When a 
bell rings at site x, and there is a particle at x + \ and a hole at x — |, the contents at 
sites x + \ and x — ~ are "interchanged" . The construction induces again a function of 
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time 



time t 



Figure 11. Graphical construction of TASEP. The * represent the events 
of the Poisson process u>. 



18 



uo and the initial configuration 7] : 

(t,w,rj) t-> (j)(t,uj,r}o) (19) 

and r) t = <fi(t, -, 770) is the TASEP with initial configuration r/ . We say that the points ui 
govern the process rjt- As at (|T2*j) one has 

rj t = <f)(t- s,uj,t) s ) (20) 

for all < s < t < 00. 

The Bernoulli product measures v p (and mixtures of them) are again invariant for the 
TASEP. (In addition, certain blocking measures are also invariant; these measures are 
concentrated on a single configuration with only particles to the left of some site and only 
holes to its right). 

If a trajectory (r]t,t G M) satisfies (|12|) for all— oo<s<t<oo then we again say that 
it is governed by u. The following result is analogous to Proposition OJ 

Proposition 8. Let p G (0, 1). Then there exists an essentially unique function H p map- 
ping elements 10 of Q to trajectories (rjt,t G M) such that: 

(i) The induced law of (r] t ,t el) = H p (uj) is stationary in time. 

(ii) The marginal law of r] t for each t is space-ergodic with particle density p. 

(iii) With probability 1, (r] t ,t el) is a TASEP evolution governed by uj. 

Then in fact the marginal law of r] t for each t is v p . 




Figure 12. Coupling in TASEP 



4.1. Coupled and multiclass TASEP. The basic coupling between n TASEPs with 
initial configurations 77 = rfc, . . . ,t)q is given by r] t = (r)l, . . . ,r/™) = (f)^ n '(t, u, r/ ), where 
4>^(t,cu,r] ) k = 4>(t, to, ?7q). See figure IT21 where the effects of three possible Poisson bells 
are indicated. If i]q < ■ ■ ■ < t/q , then this ordering is preserved by the coupling. Thus we 
obtain a coupled process (rjt), governed by ou, taking values in X n ^ . 

The equivalent multiclass process (£ t ) with values in y n is then obtained by putting 
£t = R^t- The evolution of this multiclass TASEP is more intuitive than in the case of the 
HAD process. At the ring of the bell at x, particles of lower class at site x + \ jump over 
particles of higher class at x — |, exchanging places. See four examples of jumps in Figure 
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Figure 13. Coupled and multiclass TASEP 

Theorem 9. Under the conditions of Theorem^ n, the distribution ofr] = Ta is invariant 
for the coupled TASEP (r] t ), and \i, the law of Ma, is invariant for the multiclass TASEP 

(6)- 

The strategy to prove this theorem is the same as for Theorem 0] The differences come 
in the definitions of dual points and of the multi-line process. The key steps are given by 
Proposition II II and Proposition IT2"l which play the roles played by Propositions |H1 and [7] in 
the case of the HAD process. 

4.2. Dual points in TASEP. We now define the dual points for the case of TASEP. Let 
the density p be fixed and let u be a Poisson process onRx (Z + |). Let t G M) be 
the TASEP trajectory H p (uj) governed by u>, as provided by Proposition |H1 Now define the 
dual points A p (cj) by 

A p (u) = {(x,t) e uj : 7/t_(x + |) = 1} U{(x + l,t) : (x,t) G lo and rj t -(x + \) = 0}. (21) 
See Figure ITU 

Proposition 10. Let u be a Poisson process in M. x Z, and let A p (uj) be the dual points for 
the TASEP trajectory with particle density p governed by u. Then A p (u) is also a Poisson 
process inlxZ. Furthermore {(x, s) G A p {uo) : s < t}, the set of dual points earlier than 
t, is independent of the configuration r\t- 

Proof. This is a kind of Burke's theorem like Proposition |3J Again the TASEP trajectory 
does not determine the points of u, so we introduce spin-flip processes to mark the missed 
points. There are two types of points missed by the trajectory: those space-time points 
(x,t) such that r] t -(x + \) = and those space-time points (x,t) such that rj t -(x + \) = 
r] t -(x — |) = 1. We mark these two types with different spin-flip process. Let be a 
process taking values in X = {0, 1} Z which behaves as follows: when there is an u point 
at (x,t), if there is no rj t _ particle at x + |, then the value of 7 at (x + |,t) flips so that 
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Figure 14. The circles represent the dual points of the TASEP trajectory 
of Figure ^2 As in Figure turning the picture upside-down exchanges the 
roles of circles and stars. 

lt(x + |) — 1 ~ lt-(%+ !)• Let ( t be a spin-flip process taking values in {0, with the 
following behavior: when there is an u point at (x, t), if both x — \ and x+\ are occupied 
by rjt- particles, then the value of ( at (x, t) flips so that Ct( x ) = 1 ~~ Ct-(x)- Given the 
evolution ((r]t,jt,Ct), t G R), the points to can be recovered by 

u = {{x,t) : (77 t _(x + |), 7t _(x + i),C t -(x)) ^ (^(x+ijT^^ + ^^^ + i),^))} (22) 

We now proceed as in the proof of Proposition The process ((r)t,jt,(t), t G R) is 
stationary with time-marginal product measure v p x i/ 1 / 2 x z/ 1 / 2 . The reverse process with 
respect to this measure is defined by (VtiltXt) = (V-t-il-t-X-t-)- Then the law of 
this time-reversal is the same as the law of the space-reversal. (In particular, the first 
coordinate of the reverse process performs a TASEP with jumps to the right, while the 
other two coordinates have the same spin flip distribution as the forward process). The 
points governing the reverse process are the time-reflection of A p (u), which is therefore 
also a Poisson process onMx (Z + |). Independence is shown as in Proposition □ 

4.3. Multi-line TASEP. We now define a multi-line TASEP a t = (aj,...,<) taking 
values in X n and governed by Poisson points uo on R x (Z + ~). The definition is analogous 
to that of the multi-line HAD in Section 13.31 

Let p 1 , . . . , p n G (0, 1). Let u n = ou, and, recursively for k = n — 1, . . . , 1, let = 
A pk +i(u k+l ). Now let the fcth line of the process, (a k ,t G 1), be H pk (u k ), the TASEP 
trajectory with density p k governed by the points ui k , as provided by Proposition |H1 

Using Proposition EB an argument analogous to the proof of Proposition El now gives 
the following result: 

Proposition 11. The multi-line TASEP (a t ,t G R) is stationary, and the distribution of 

1 71 

at for each t is the product measure v = v p , . . . , v p . 
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The proof of Theorem |U] is completed by the following result, analogous to Proposition 

m 

Proposition 12. Let < p 1 < ■ ■ ■ < p n < 1, and let (a t ,t E R) be the multiline TASEP 
trajectory governed by to with densities p 1 , . . . ,p n . Let rjt = Tat G X n ^ . Then (r]f,t G R) 
is the TASEP trajectory governed by uj, with particle density p k . 

About the proof of Proposition [T2"l The induction argument is the same as for Propo- 
sition The case- by-case checking for n = 2 must now be done for the TASEP dynamics. 
We have done this in ^2]- □ 

5. Other dynamics 

There are other examples of dynamics on X for which the associated multiclass processes 
also have the family of measures /i as invariant distributions. 

For example, consider the sequential TASEP. This is a discrete-time Markov chain with 
values in Z. At each time step, each particle tries to jump left with probability p, succeeding 
if the site to its left is empty. Updates are carried out sequentially from left to right (so for 
example a particle may jump into a space which is only vacated at the same time-step). 
Now the governing points uj have Bernoulli product measure on Z x Z (and the same is true 
of the dual points, appropriately defined). An analogous method of proof via a multi-line 
process shows that /i is invariant for the multiclass process. 

The same is true for a form of sequential TASEP with updates from right to left. Now 
a particle may not jump immediately into a vacated space, but the same particle may 
jump several times at the same time-step (because of several neighbouring points (x,t), 
(x — l,t),... in the governing configuration uj). In fact this process is dual to the one in the 
previous paragraph, under exchange of hole and particle and of left and right. The measure 
fj, is invariant for the multiclass version, and similarly in the case of various discrete-time 
versions of the HAD process. 

However, consider instead the parallel TASEP, again in discrete time. All sites are 
updated simultaneously; now jumps are only allowed at sites containing a particle with a 
hole to its left before any other update occurred. In particular, jumps at two neighbouring 
sites cannot occur at the same time-step. In this case, the basic coupling does not even 
preserve ordering of configurations, so that the multiclass process cannot be defined in the 
same way. Note also that product measure v p is no longer invariant for the parallel TASEP. 

Consider also the asymmetric simple exclusion process (ASEP) in continuous time, in 
which each particle tries to jump left at rate p and right at rate 1 — p. Product measure 
v p is invariant for the process; however, unless p = 1, the measure /i is no longer invariant 
for the multiclass process. A very interesting question is whether the invariant multiclass 
measures of these more general ASEPs could be constructed using an approach related to 
the one described here for the TASEP. 
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6. Multiclass Burke's Theorem 

For each n and densities < p 1 < ■ ■ ■ < p n < 1, we have constructed a measure 
[i = fi i p „ on^n = {1,2,..., n+l) z which is invariant for the multiclass HAD process and 

the multiclass TASEP. A configuration from [ffl pn has density p 1 of first-class particles 
and density p k — p h ~ 1 of kth class particles, for k — 2, . . . , n. 

Fix n and p 1 , . . . , p n , and let m < n. Let £ ( - n ) be distributed according to /i i n , and 
£( m ) according to m . Then a nice property of this family of distributions is that 

£M the same distribution as [£( n )] m , (23) 
where [£^] m is the truncated configuration defined by 

[£ (n) ] m (z) = min{£ (n) (z),m+l}. 

Putting n = m+1, we obtain the following statement in the context of the tandem queueing 
system described in Section [21 the m-class input process to queue m has the same law as 
the m-class departure process from the same queue. Thus the measure m is a fixed 

point for a discrete-time ./M/l priority queue with m classes (here ./M/l denotes a queue 
whose sequence of potential service times is a Bernoulli process). 

This may be called a multiclass Burke's theorem. The original form of Burke's theorem, 
in this discrete-time setting, states that a Bernoulli process is a fixed point for a (one- 
class) ./M/l queue; this is the statement (|23|) specialized to the case n = 2 and m = 1 
(see e.g. |2BJ, and [IE] for the discrete-time case). Property (|2l?|) is easy to deduce from 
results above, using the uniqueness of the invariant measure for the coupled process with 
given particle densities (see ^1] for the equivalent argument in continuous time). A more 
direct proof can be found in [22] , using properties of invariance of the law of the departure 
process from a tandem queueing system under interchange of the order of the queues. 
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